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In this work we provide a comprehensive analysis of the activation problem out of equilibrium. 
We generalize the Arrhenius law for systems driven by non conservative time independent forces, 
subjected to retarded friction and non-Markovian noise. The role of the energy function is now 
played by the out of equilibrium potential = — limT^o 7^ log Ps, with Ps being the steady state 
probability distribution and T the strength of the noise. We unveil the relationship between the 
generalized Arrhenius law and a time-reversal transformation discussed in the context of fluctuations 
theorems out of equilibrium. Moreover, we characterize the noise-activated trajectories by obtaining 
their explicit expressions and identifying their irreversible nature. Finally, we discuss a real biological 
application that illustrates our results. 
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The Arrhenius law originally discovered for the rate 
of chemical reactions p] is one of the most important 
principles governing the behavior of systems character- 
ized by several energy scales. The diffusivity of vacancies 
in crystals , the viscosity of strong super-cooled liquids 
[3], the rate of protein folding [4 are just few examples 
showing the broad range of physical situations in which 
the Arrhenius law holds. This happens whenever the dy- 
namics of the system at hand is dominated by a process 
requiring an activation energy much larger than the 
temperature. In this case, the time-scale characterizing 
the dynamical behavior is given by 



r ^ To exp 




thus leading to the same behavior for several observ- 
ables related to the relaxation time (rates, diffusion co- 
efficients, etc.). In this equation tq is, roughly speaking, 
the high-temperature time-scale [5]. 

The usual domain of applicability of the Arrhenius law 
is restricted to systems at equilibrium (or in a metastable 
equilibrium, as in the case of nucleation processes). In 
this case the Arrhenius law can be derived in several 
ways. The original proof is due to Kramers [6 , who 
obtained it for a particle undergoing Langevin dynam- 
ics with white noise. A natural question is to what 
extent this can be generalized to non-equilibrium sys- 
tems, which are nowadays witnessing a growing interest, 
e.g. gently shaken granular media, sheared fluids at low 
temperature, active matter, single molecule experiments, 
biochemical networks. These systems are out of equi- 
librium because are driven by forces that do not derive 
from a potential and are subjected to noise that does not 
necessarily correspond to a thermal bath at equilibrium. 
If the force field is time-independent then a stationary 
probability distribution is generally reached at long time, 
but it is not given by the Gibbs-Boltzmann distribution 
ex.-p{—E/T) since for non-conservative force fields there 



is no energy function to start with. In consequence, the 
usual intuition behind the Arrhenius law, which is based 
on a stochastic dynamics in an energy landscape charac- 
terized by a barrier A^, becomes meaningless. Yet, ex- 
periments, such the ones of [7] on shaken granular media, 
suggest that in the low noise regime a generalization of 
this law does exist. Despite some results obtained in spe- 
cific contexts [61I8HT3], a general and comprehensive anal- 
ysis addressing this issue is still lacking. Here we fill this 
gap: for driven systems subjected to non-thermal and 
in general multiplicative non-Markovian noise we derive 
the generalization of the Arrhenius law and identify the 
corresponding rare noise-activated paths followed during 
the dynamics. Our theory applies to force fields char- 
acterized by more than one stable attractor and in the 
small noise limit, meaning that the timescale to "jump" 
from one attractor to the other is much larger than the 
characteristic timescales to vibrate around them. As we 
shall explain, our results can be understood physically in 
terms of a generalization of time-reversal symmetry dis- 
covered in the context of fluctuations theorems |l4lll6] . 
In order to illustrate our results we provide an explicit 
example inspired by bacteria evolution in the intestine 
caused by antibiotic administration [17 . 

We start our analysis by focusing on a simplified model 
defined by the Langevin equation: 

7^=F + r, (1) 

where F is the force field, 7 is the viscosity, 77 a Gaussian 
multiplicative noise, possibly corresponding to thermal 
fluctuations. We assume that rj has zero mean and vari- 
ance {r]a{t)r](3{t')) = 2TjH{x)S{t - t')Sa,(3 where i^(x) 
is a generic positive function of x and T is the strength 
of the noise fluctuations (it only coincides with temper- 
ature for an equilibrated bath). The force field F is non- 
conservative therefore the system is kept out of equilib- 
rium: it dissipates heat with the reservoir and does (or 
receives) work because of the force field. More general 
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systems containing an inertial term, retarded friction and 
non-Markovian noise will be considered afterward. In or- 
der to study a simple but instructive case of activated 
non-equilibrium dynamics we focus on a force field char- 
acterized by three fixed points corresponding to F = 
(two stable, 6'i,5'2, and one unstable U). This is the 
counterpart of the usual process, a jump through an en- 
ergy barrier, studied to derive the "equilibrium" Arrhe- 
nius law. Our derivation is based on the Martin-Siggia- 
Rose field theory [18 , whose action using Ito convention 
is: 



F(x) - Ti7(x)x 



where x is the response field and we use time units such 
that 7 = 1. 

In the low noise limit, T ^ 0, the dynamics can be de- 
scribed in the following way. The system first flows fol- 
lowing the force field toward one of the stable points, 
whether this is Si or S2 depends on the starting point, 
and then fiuctuates locally around it. On much larger 
times, rare configurations of the noise eventually induce 
far away excursions allowing the system to escape from 
one basin of attraction to the other. The characterization 
of these dynamical processes can be obtained by comput- 
ing the probability P{Si 82]^) that a system starting 
in Si at time ti is in 5*2 at a very large time tf = t -\-ti. 
This is given by sum over all paths [x(t)] that connect 
these two points in a time t. Each trajectory is weighted 
by the exponential of its corresponding action. In the 
low noise limit it is straightforward to check that the 
sum over paths is dominated by the saddle point contri- 
butions because one can pull out a 1/T factor in front of 
S by redefining x :k/T. The functional integral is thus 
approximated by the sum of the paths that verify: 
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In the equilibrium case, the solution of the saddle point 
equations can be constructed in terms of the downhill 
trajectory, that corresponds to the path going from the 
unstable point towards one of the stable ones, and the 
uphill trajectory that corresponds to a path going in the 
opposite direction. The extremal paths on which one has 
to sum to obtain P{Si S2]t) are all possible com- 
binations of the uphill and the downhill ones concate- 
nated in such a way to verify the boundary conditions 
x(ti) = x^^ and x(tj) = X5'2. The detailed computa- 
tion, which is analogous to the so called dilute instanton 
gas, is presented in [19 . In order to extend it to the 
non-equilibrium case we look for the generalization of 
the downhill and the uphill solutions. The former is im- 
mediately found: it corresponds to x = F and x = and 



leads to a null action. This means that the corresponding 
weight is of the order of one, as expected physically, since 
the downhill trajectory is a typical one and does not need 
to be activated by the noise. The main problem is to find 
the uphill trajectory going, say, from SiioU . In equilib- 
rium conditions, corresponding to F = — and H = 1, 
the uphill trajectory is the time-reversed of the downhill 
one and reads x = VE and x = x/T = VE/T. The cor- 
responding action S = -{E(U) - E{Si))/T = -AE/T 
leads to an Arrhenius weight, e~^^/-^, for the uphill so- 
lution. 

The naive guess for the generalization to the non- 
equilibrium case where one substitutes — with F, 
leading to x = — F and x = x/T, does not work. In 
order to find the solution of this conundrum, we have 
to introduce the zero noise non-equilibrium potential 
= liiRT^o —T log Ps{x.)^ with Ps being the station- 
ary probability distribution. In mathematical language 
(f) is the large deviation function determining the prob- 
ability of rare events in the zero noise limit. Plugging 
Pg e~^^^ into the Fokker-Planck equation one finds 
that (j) verifies the equation 



• (F + i^(x) V(^) + O (T) = 



(3) 



Since (j) somehow plays the role of the energy function, a 
natural generalization of the uphill solution can be found 
replacing E with in the expression for x, i.e. x = 
^(j)/T. Given the second equation of ([2|, this choice 
leads to: 



X = F + 2i^(x) V(y 



V(/>/T, 



(4) 



which indeed provides a solution also for first equation 
as it can be checked by direct substitution and by 
using the derivative of eq. ([3|. The action associated to 
the uphill solution reads: 
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(F + i/(x)V(/)) (5) 



Noticing that the last term between parenthesis is zero 
because of ([3|, we are left with the integral of a total 
derivative and, therefore, S = Hence, we indeed 

obtain the generalized Arrhenius weight, e~^^l^ for the 
uphill solution. By combining together uphill and down- 
hill solutions, as done in [19 , one finds that 

P(^i^52;t)=P,(x5j(l-e-^) 

r(T)^roexp^ ^ 

where tq contains the sub-leading contributions to the 
generalized Arrhenius law coming from the Gaussian fluc- 
tuations around the instantons. On the basis of the re- 
sults of [9] we expect that an explicit computation should 
lead to the result Tq"^ 
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where Aq is the real part of the lowest eigenvalue of 
dFo,/dxf3 evaluated in U and the uof^ and the cjf^s are 
the eigenvalues of the Hessian of (j) evaluated in U and 
Si respectively. 

Note that in general the solution of a system of equa- 
tions like ([2]) with fixed initial and final conditions is not 
straightforward at all, and can be only obtained numeri- 
cally by the shooting method (one searches by trial and 
error the initial position and velocity that leads to the 
correct solution). Thus, being able to provide the ex- 
plicit solution and, in top of that, finding that the action 
is the integral of a total derivative are quite unexpected 
simplifications. In equilibrium, they are due to the exis- 
tence of the time-reversal symmetry [16 . Remarkably, a 
generalization of the time-reversal transformation, which 
was introduced in the context of fiuctuations theorems 
out of equilibrium [121 fT4Hl6] , provides a physical expla- 
nation for the non-equilibrium case too. This transfor- 
mation gives a relationship between the probability of a 
dynamical path and its time reversal in the so called ad- 
joint dynamics corresponding to the Langevin evolution 
in a renormalized force field Ya = — F — 2i^(x) V(/): 

P([x(t)]; 5i ^U) = PA([x(-t)]; U ^ ^i) e'^ . (6) 

In this expression Pa denotes the probability of paths 
evolving with the adjoint dynamics [20]. In order to iden- 
tify the uphill trajectory one has to maximize the LHS. 
Instead of solving this difficult problem, one can solve 
the much easier one consisting in maximizing the RHS 
associated to the downhill trajectory in the adjoint dy- 
namics. Since the exponential term is path-independent 
(the boundary conditions are fixed), the most probable 
path for T ^ is just the one that follows the force field 
= — F — 2i^(x)V^ going from the unstable point U 
to the stable one Si [21 . Because of the identity (|6|, 
the time-reversal of this path is the one maximizing the 
LHS and, indeed, corresponds to the uphill solution. In 
conclusion, the generalization of the time reversal trans- 
formation provides the physical principle behind the gen- 
eralization of the Arrhenius law and an explanation for 
the unexpected simplifications we discovered. 

An important difference with the equilibrium case is 
that the large deviation function (j) is not known a pri- 
ori. Thus, it may seem that the previous results are of 
little use in practice. However, the explicit integration 
of eqs. in Q between Si (or 5*2) and U and the evalua- 
tion of the corresponding action allows one to explicitly 
obtain A0. Actually, this procedure is more general and 
allows one to completely reconstruct 0(x) up to a nor- 
malization constant. In order to do it, one can partition 
the phase space in basins of attraction associated to each 
stable point. The non-equilibrium potential for a point 
belonging to the basin of, say, is given by ^(x^-J plus 
the action evaluated on the trajectory that connects 
to this point. This can be understood by noticing that 




FIG. 1. Non-equilibrium potential for e = 1.2, / = 1.12, 
= 0.7. 



under the time-reversal mapping the action S transforms 
into the action for the downhill solution, which is null, 
plus IS.(^IT between the final and the initial points. By 
comparing the values of for points along the separa- 
trix one can completely reconstruct (/>(x) up to a normal- 
ization constant. Mathematically, this is related to an 
underlying Hamilton- Jacobi theory that applies to eqs. 
like the ones in % [I51122]. 

In order to show an explicit example of our theoreti- 
cal framework, we focus on a biological-inspired example 
related to the study of the time evolution induced by an 
antibiotic treatment of bacterial microbes living in the 
human intestine [17 . This dynamical system was mod- 
eled in terms of an over-damped Langevin equation char- 
acterized by white noise and the non-conservative force 
field F(x, y) = (^^ - ex, - i/jxy - y). The vari- 
ables X and y describe the concentrations of the bacteria 
which are respectively sensitive and tolerant to the an- 
tibiotic. The constant e, / and are related to mortality 
rate, fitness and interactions between bacteria popula- 
tions. This system exhibits a region of bistability for 
a particular choice of the parameteres with two stable 
points = (0, 1) and 5*2 = (1/e, 0), and an unstable one 
U = { ^^^^ , ^"^^77^ )• order to illustrate our theory, 
we compute the non-equilibrium potential (j) by evaluat- 
ing the action for all the extremal trajectories starting 
from stable points (Fig.l). It is double- well shaped with 
two minima associated to Si and 6*2 and one maximum in 
correspondence to U . Then we characterize the optimal 
paths that interpolates between the two stable points, 
see Figj2] The most striking difference with the equilib- 
rium case is that uphill and downhill trajectories pass 
through different regions of the phase space. The rea- 
son for this can be understood by recalling that out-of- 
equilibrium systems substain a steady state probability 
current, J = (F — TV)Ps. In the zero noise limit J equals 
(F + V^)Pg and is orthogonal everywhere to the gradi- 
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system of stochastic equations: 
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FIG. 2. Saddle point trajectories in the field of forces Y{x^y) 
with the choice of the parameters e = 1.7, / = 1.12, '0 = 1.1 
and initial condition Xi = 5*1, \xi\ = 0.0032 (red) and Xi = 
S2^\xi\ — 0.0032 (green). The plot shows clearly that uphill 
and downhill paths visit distinct regions of the configuration 
space. 



ent of the potential because of eq. ([s]). Hence, uphill and 
downhill trajectories can be respectively decomposed in 



two perpendicular contributions: x| 



uphill 



J/Ps 



and ^downhill = -V(/) + J/Pg. These paths correspond 
to gradient ascent and descent, similarly to equilibrium. 
However, contrary to this case, the system also flows 
along the direction given by the probability current and 
therefore visit different portions of the phase space de- 
pending whether it is moving uphill or downhill [23] . 
Another interesting finding that differentiates activation 
in and out of equilibrium concerns the work done on 
the system by the force field: W = J dtic - F. We 
can compute W along the two trajectories and obtain 
that, in both cases, it can be split into two contribu- 
tions: W = Tj dtJ'^/{TP^) - Uixf) - (l){xi)). If we 
compute the work done in a closed cycle, we obtain that 
only the first term, related to the current, is always dissi- 
pated while the second term vanishes. The system indeed 
releases to the bath an amount Acj) when it gradient de- 
scends and it absorbs the same quantity during the gra- 
dient ascent. Using the result in which states that 
the total entropy produced along a given trajectory reads 
AS = / (it J^/(TPg^), one can recast the previous equa- 
tion for in a form resembling the first law of thermo- 
dynamics: W = TAS — A(j). The main differences with 
respect to the first law are that the previous expression is 
valid for a given trajectory and that the internal energy, 
which does not exist for a driven system, is replaced by 
the out of equilibrium potential (j). 

Let us finally discuss the most general physical case we 
are able to treat, which is characterized by the following 



mxc 
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where 'ya,(3{t — t') is a function related to retarded fric- 
tion, symmetric with respect to the interchange of a, /3 
and equal to zero for t <t' and Ja,(3{t — t^) is a symmetric 
positive-definite operator associated to non-Markovian 
noise [25]. Physically, eq. ^ corresponds to a sys- 
tem which undergoes Netwonian dynamics in a non- 
potential force field and is coupled to an out of equi- 
librium thermal bath (only in the case H = 1 and for 
la,i3{t — t') + 7Q;,/5(t' — t) = 2ja, i3 the bath is at equi- 
librium). The main trick we used to analyze this case 
consists in reducing the problem to the one we already 
solved. This is done by showing that the general stochas- 
tic equation above can be rewritten in terms of over- 
damped Langevin equations characterized by white noise 
in an extended configuration space where new extra vari- 
ables are introduced: the inertial term is handled by in- 
troducing the momentum, p = mx; whereas retarded 
friction and non-Markovian noise can be represented as 
the result of integrating out a bath of harmonic oscilla- 
tors linearly coupled to the system and evolving by an 
over-damped Langevin equation characterized by white 
noise [26] . More details and the explicit calculations can 
be found in the SI text [27] . 

In conclusion, we provided a general and comprehen- 
sive analysis of the problem of activation out of equilib- 
rium. We showed that the Arrhenius law holds for a very 
large class of out of equilibrium systems provided that the 
energy function is replaced by the non-equilibrium poten- 
tial 0. The most important difference with the equilib- 
rium case is that the noise- activated paths are no longer 
related by a simple time reversal transformation: uphill 
and downhill paths visit different regions of the configu- 
ration space. We characterized these trajectories by ob- 
taining their explicit expression, by identifying their irre- 
versible nature and by unveiling how they are related to 
a generalization of the time-reversal transformation. We 
illustrated our results in an explicit example borrowed 
from biology where equilibrium is not even a well defined 
concept. We envision many possible interesting applica- 
tions in different fields ranging from physics to economics, 
where equilibrium is a limiting assumption. 
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